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The questions in the main body of the text are ordered and numbered 
to indicate differing levels of detail. Thus 2.0 is the most 
general level of subject, 2.1 is more detailed, etc. 


For a summary of the IMPAC objectives and approach see the general 
introduction. 


Most of the areas and items in the list of questions have a brief 
introduction which describes their place in the survey. 


A glossary of terms is included to provide standard definitions. 
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THE IMPAC QUESTIONS 
Introduction 


The Comptroller General is responsible for financial administration, 
planning and control, and for the closely related operational controls 
upon which an effective financial function depends. The latter include, 
in particular, performance measurement and program evaluation policies 
and practices. 


The responsibilities of the Comptroller General are distinct from the 
central role of the Treasury Board Secretariat, which is for the 
direction, planning, review and control of expenditure plans and 
programs and their relative priorities; for general administrative 
policy; and for government policies and practices in the fields of 
personnel management and official languages. 


The demands of such a large, decentralized, multi-program organization 
such as the federal government are such that only a consultative 
process can make effective the relationships between the Office of the 
Comptroller General and departments and agencies. This consultative 
process must develop from an agreed base which outlines concisely the 
present state of management practices and controls, the changes being 
planned in them, and the time table for the implementation of such 
changes. 


As a first step in outlining this base, the Comptroller General has 
initiated a survey called IMPAC, "Improvement in Management Practices 
and Controls". This survey, which will cover the top twenty depart- 
ments of Government in terms of budgets and manpower, is designed to. 
establish an understanding across the twenty departments and within 
each department of where we are and what needs exist. The result of 
the survey will be a set of plans which will address actions required 
to fulfill the needs, the sequence or priority of such actions, and 
the timetable for accomplishing them. These activities will result 
from close interaction of the personnel of the Office of the Comp- 
troller General with those of departments. All priorities and plans 
will be agreed between the Comptroller General and the deputy minis- 
ters involved. 
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The questions which follow in this document will be used to focus the 
research during Stage I of the IMPAC survey, assure a common and 
consistent approach across departments and provide a "quality control" 
on the officers of the OCG who actually perform the survey. They will 
guide the work of the IMPAC study groups in the examination of manage- 
ment control practices on a department-by-department basis. The aim 
of the information gathering in Stage I is simply to establish the 
base from which plans will be developed. é 
The process for assembling information in Stage I, including the use 
of questions, has been designed to produce adequate results with the 
least direct demands on departmental time. Many of the questions are 
drawn directly or indirectly from existing policies and guidelines 
covering financial management, program performance measurement and 
program evaluation. Others arise from commonly accepted practices or 
are based on the practices presently used by some departments which 
are deemed to be of a high order. 


Much of the information needed to complete the survey is already 
available in the central agencies including the Auditor General, and 
these sources will be tapped first. This means that departments will 
be approached directly to provide only information not available 
centrally, and to confirm that the information gathered earlier is 
valid. 


The questions are organized into four areas and these areas in turn 
are broken down into items and sub-items. The areas (I-Planning, 
I1-Organizing and Implementing, III-Controlling, IV-Internal Audit) 
encompass the principal functions of management control. The items, 
14 in all, are a more detailed breakdown of the areas. In this docu- 
ment each area and item is introduced by a brief description of its 
place in management control and within the questionnaire. 


Rating of Areas 


Once the survey information has been gathered it will be used to 
develop a rating for each of the sub-items that serve as headings for 
the questions. Each of these sub-items will be given a rating at one 
point on the scale: 
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Fully satisfactory (minor suggested improvements) 
Generally satisfactory (minor required improvements) 


Improvement required - 2nd Priority (one or two major required 
improvements ) 


Improvement required - lst Priority (several major required 
improvements). 


As the IMPAC study group gathers the information under each sub-item 
there may be times when more detailed questions than those listed in 
this document will be required. In such cases, the study groups have 
been instructed to expand their discussions with departmental staff to 
ensure their understanding of the subject area is based on fact, . 


The ratings for each sub-item will be rolled up to provide item ratings 
and area ratings. The discussion of the ratings and the documentation 
supporting them will be the prime tool for identifying needs, estab- 
lishing priorities and developing action plans. 


The Comptroller General's Approach 


The IMPAC survey does not in any way attempt to define policies and 
practices of management control. The questions are built on accepted 
principles of management control, on the existing financial manage- 
ment, performance measurement, and program evaluation policies, and on 
present practices in selected departments that are deemed to be of a 
high order. 


The following summarizes those generally accepted principles and 
processes which lie behind the survey: 


18 Good financial controls and systems depend upon good operational 
controls and systems. The beginning point for financial controls 
is the existence of operational plans based on specific objec- 
tives and targets. These plans must specify what is to be accomp- 
lished, when, and by whom during the current year. In detailing 
what is to be accomplished, operational plans must also, to the 
extent appropriate, specify the levels of performance to be 
attained in terms of effectiveness, efficiency, quality and level 
of service. 
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Zs Operational plans, broken down into detailed tasks and require- 
ments that are costed, become budgets. 


7: Operational plans and budgets should be developed, in the first 
instance, at a level of aggregation that fixes initial responsi- 
bility with a single manager. This is usually the responsibility 
centre in government. Plans at the program or other level repre- 
sent different aggregations of the unit plans by responsibility 
centres. 


4. The control that can be exercised over the direction of an enter- 
prise is directly related to the extent of detail with which 
plans for the enterprise are developed. 


on Actual operating results have to be compared to corresponding 
plans, before the progress of any enterprise towards its objec- 
tives can be properly assessed and understood. 


Ge Operational plans, financial budgets and the subsequent budgets 
and the subsequent performance reporting against them have to be 
examined by managers and used in controlling their operations. 
Off-standard or unplanned events have to be perceived and the 
reasons understood; this may require additional analysis. Cor- 
rective actions have to take place by changing something--either 
elimination of the causes of the off-standard performance or 
modification of the plans themselves. After all that, there has 
to be continued examination of results to ensure that the action 
taken did, in fact, produce the intended results. 


The IMPAC survey is not an audit. The final result will be a schedule 
of events that must occur to fulfill needs with which the department 
and the OCG are in agreement. There will be complete access by depart- 
ment staffs affected to the survey results and its supporting documen- 
tation as required. 


The positive and active support of department staff is essential to an 


effective result and the fulfillment of needs for which departments 
and the Comptroller General have a collective responsibility. 
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Line Manager's Introduction 


The organization of material in the questionnaire corresponds much 
more directly to an outline of the general concepts of management than 
it does to the needs and point of view of line management. This 
pattern was chosen deliberately because it is the most effective way 
to analyse a whole system and because it will help the Comptroller 
General meet his responsibilities to Treasury Board Ministers. The 
perspective of the line managers may often be different from that of 
the comptroller or the other functional specialists of the control 
function. : 


The line manager's interests touch all aspects of management but are 
focused on the day-to-day running of the program. Thus, in the IMPAC 
questions, every item will have some interest, but line managers will 
find their concerns concentrated in items 3, 4, 9, 10, and 12 in terms 
of day-to-day activities, and in items 2 and 11 from a longer term 
point of view. The other items look at pieces of the control infra- 
structure which are vital to the support of the central line manage- 
ment functions. 


The cornerstone of good control is good planning and budgeting at the 
responsibility centre level. IMPAC aims at identifying any impedi- 
ments to the use of practices and systems which permit line managers 
to perform their functions effectively, efficiently and economically. 


The use of a questionnaire as the basis of the IMPAC research carries 
certain dangers with it since it may be assumed from the questions or 
the structure of the questionnaire that the Office of the Comptroller 
General (OCG) is promoting a single organizational structure; or that 
it considers that a certain process must invariably be given high 
priority; or that certain functional activities should be carried out 
by units reporting to individuals with a particular title. The OCG 
recognizes that structures must differ from one department or agency 
to another in order to reflect different roles, management styles, or 
the size of the organization. However, no matter what the situation 
may be within an organization, certain functions and activities, in 
some form, must exist if the organization is to remain healthy. 
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GLOSSARY OF TERMS 


Accounting: 


Cash accounting is a method of recording transactions so that 
revenues and expenses are reflected in the accounts for the 
period when funds are disbursed or received. 


Commitment accounting is the principle of recording transactions 

so that commitments are reflected in the accounts for the period 

when an obligation to make a future payment is foreseen, such as 

when contracts are entered into or orders are placed for goods or 
services. 


Cost based accounting is a method of recording transactions so 
that revenues and expenses are reflected in the accounts for the 
period when resources are earned or consumed. 


Accrual accounting is a method of recording transactions so that 
assets and liabilities are reflected in the accounts for the 
period when goods are received or delivered or when services are 
performed. 


Annual appropriation is an appropriation, as defined in Section 2 of 
the Financial Administration Act, in a fixed amount voted from an item 
included in the Estimates, the authority for which lapses at the end 
of the fiscal year. 


Allotment is a sub-division of an appropriation, approved by Treasury 
Board under Section 24 of the Financial Administration Act, that 
departments may not exceed or amend without approval of Treasury 
Board. 


Budgets are plans for achieving objectives, expressed in quantitiative 
terms, covering a specified period of time. Budgets in government 
serve three main purposes. The first is to determine the financial 

and other resources required to carry out the plans assigned to respon- 
sibility managers; the second is to obtain Treasury Board and Parlia- 
mentary approval of departmental programs and resource requirements; 
the third is to provide a basis for control. 
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Control is any process that guides activity toward some predetermined 
goal. The essence of control is in determining whether the activity 
is achieving the desired results. A control system requires: 


ike a predetermined goal and plan; 

2: a means of measuring actual activity; 

a. a means of comparing actual activity to planned, and 

&. a means of analyzing and correcting the current activity so as to 


achieve the desired results. 


Financial officers are officers who provide support to responsibility 
centre managers with respect to financial administration and who, 
among their other responsibilities, have primary responsibility for 
controlling cash appropriations and allotments and for exercising 
delegated payment authority. 


Financial and signing authorities is a collective term used to iden- 
tify spending authority, payment authority and the authority to give 


commitment certificates. These are authorities which are assigned by 
the Financial Administration Act to ministers or deputy heads of 
departments and those to whom they specifically delegate their au- 
thority, and which require a signature on a certificate or some other 
document. 


Spending authority is the authority delegated by ministers and 
deputy heads under the Financial Administration Act to incur 
expenditures, and to confirm satisfactory contract performance 
and price under Section 27 of the Act as a prerequisite to the 
requisitioning of payments. 


Payment authority is the authority delegated by the appropriate 
minister under Section 26 of the Financial Administration Act to 
requisition payments and authorize their charge to appropria- 
tions, after reviewing the legality of payments and the exercise 

of all appropriate financial controls. This authority is to be 
distinguished from the authority to make payments which is assigned 
to the Receiver General under Section 28 of the Act. 


Internal Audit is the independent, systematic appraisal activity that 
examines the operational and administrative control framework, evalu- 
ates its adequacy, and reviews the organization's performance in 
relation to this framework for the purpose of advising management as 
to the efficiency, economy and effectiveness of the operational and 
administrative support functions. 
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Organizing is the process of identifying, dividing and grouping the 
work to be performed; defining responsibilities, delegating authority, 
and establishing accountability for the purpose of enabling people to 
work most effectively and efficiently together in accomplishing pre- 
determined objectives. 


Planning is the process of setting objectives and determining the best 
means of achieving them. The process involves allocating resources 
across time to meet the objectives. 


Strategic planning looks at the basic processes in a department 
for establishing and reviewing its most fundamental goals. 


Long term operational planning concentrates on the planning 
processes which deal with projected resource allocations. 


Current year operational planning focuses on setting precise 
operational targets for the next year and determining detailed 


activities and means necessary to meet these targets. 


Program/Activity Structure 


Program is a group of related departmental activities designed to 
achieve specific objectives authorized by Parliament. 


Activities are means of achieving an objective or set of objec- 
tives of a program. The term is also used to refer to the highest 
level of activity classification or first division of a program, 
normally that used in estimates submissions to Parliament. 


Activity elements are the basic or lowest levels of activity 
classification--they are the processes or projects carried out to 
attain a program's objectives, at which point costs can be use- 
fully and meaningfully determined. 


Program evaluation is the objective in-depth review of long term basic 
questions about overall success in achieving objectives of depart- 
mental programs. Matters such as the rationale for the program, its 
impact on the public, and its cost effectiveness as compared with 
alternative means of program delivery are reviewed. 
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Program performance information is information which tells how well a 
program is performing. It includes, as appropriate, information on 
economy, efficiency, effectiveness, quality and level of service 
provided. 


Economy is the extent to which resources of a specified quantity 
and quality are acquired at the lowest price. 


Efficiency is the ratio of output to input, e.g. volume of mail 
processed per person year, number of travellers inspected at 


customs port of entry per person year, number of jobs created per 
thousand dollars. 


Effectiveness is the extent to which an objective is achieved 
(operational effectiveness) and the intended and unintended 
effects of a program (program effectiveness). e.g. The ratio of 
actual to target number of jobs created by a job creation pro- 
gram, changes in income, behaviour, etc., of target population. 


Quality and level of service are the characteristics and appro- 
priateness of goods and services, the manner in which goods and 
services are delivered to clients and the extent to which the 
public or client's needs for services are satisfied e.g. response 


time, waiting time, error rate, utilization rate, and accuracy of 
forecasts. 


Responsibility centre managers are managers with delegated authority 

to manage financial resources, including responsibility for determining 
financial requirements, controlling costs in relation to operation 
accomplishment, and exercising spending authority to approve charges 
against their budgets. 
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I PLANNING 


The first focus of the questionnaire is upon planning -- the 
process of setting objectives and determining the most effective and 
efficient means of achieving them. This involves allocating resources 
across a time period to meet the objectives. This point is chosen as 
a beginning not only for its logic in the pattern of program develop- 
ment but because effective planning is the essential prerequisite of 
good management control. 


Planning is broken down into four items. The first, Strategic 
Objectives and Plans, looks at the basic processes in a department for 
establishing and reviewing its most fundamental goals. The second, 
Long-Term Operational Planning, concentrates on the planning processes 
which deal with projected resource allocations and operational targets 
for a period of, say, two to five years in the future. The third, 
Current Year Operational Plans, focuses on the detailed activities of 
setting precise operational targets and allocating resources to meet 
those targets for the next year. The fourth, Current Year Operating 
Budgets, addresses specifically the process of developing concrete 
financial plans, matching the operational plans, for the next year. 


The aim of the four items is to gain an understanding of how 
each department conducts its activities in this area as well as to 
determine how well the department is using these processes to lay a 
base for effective management control. Additionally, the questionnaire 
seeks information on the extent to which departments use the material 
gathered from current operational experience to revise and adjust 
plans and objectives. 


The following hypothetical example illustrates a typical 
breakdown of the main elements within planning: 
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MINISTRY OF TRANSPORT 


Strategic Level 


The strategic level would address the issue of whether the 
department should stay in the business of operating airports, i.e. 
should the operating of airports be a federal, provincial or municipal 
responsibility? 


Long-Term Operational Level: 


Given that the department, at the strategic level, had 
decided that it should stay in the business of operating airports, the 
long-term operational level would address itself to the question of 
long-term operational plans for operating airports; for example: 
should the number of airports be increased? or will Toronto require a 
new terminal building within the next five to ten years? 


Current Year Operational Level: 


Given that a new terminal building is to be built in Toronto, 
the current year level would address itself to the question of what 
was to be done in the current year in terms of constructing the new 
Toronto airport. 
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STRATEGIC OBJECTIVES AND PLANS 


Setting, Ranking and Reviewing Strategic Objectives 


Does the department identify and take into account those 
government priorities which relate to its sphere of activity 
in developing and ranking its objectives? 


Does the department systematically review its strategic 
objectives? 


Identifying Alternative Strategic Plans and 
Assessing their Costs and Benefits 


Are alternative strategic plans developed? 
Are costs and benefits of these various alternatives assessed? 


Are inventories of current and future policy initiatives 
identified in a systematic and comprehensive manner? 


Is planning information compiled? 


eg: 

1) target population data 

23 reaction of clients to existing programs 
3) socio-economic data 

4) earnings or income data 

5) social welfare data 


6) industrial data 
7) activities and plans of other related jurisdictions. 


Developing, Approving and Reviewing Strategic Plans 


Does the department have an identifiable process for strate- 
gic planning? 


Does the department prepare strategic plans? 
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Are these strategic plans documented to the extent that they 
include the following information: 


1) objectives 
2) major activities to be undertaken 


3) specification of organizational responsibilities for 
development of operational plans 
4) costs and benefits of alternatives. 


Are strategic plans reviewed and revised systematically? 


Communicating Strategic Objectives, and Plans 


Is responsibility assigned for the development of opera- 
tional plans from strategic plans? 


Are strategic objectives and plans communicated, verbally or 
in writing, to those persons and organizational units who 
either have a role to play in executing the plans or are 
affected by them? 


Management of the Strategic Planning Function 


Are roles and responsibilities for strategic planning de- 
fined and assigned? 


Are those persons primarily responsible for strategic plan- 
ning operating in accordance with these roles and responsi- 


bilities? 


Are appropriate levels of management involved in the develop- 
ment of strategic plans? 


When a staff is dedicated exclusively to strategic planning, 
what is its size? 


= person years 


5 $ 


If other staff perform strategic planning together with 
other duties, what portion is devoted to strategic planning? 


i person years 


5 ° 
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LONG-TERM OPERATIONAL PLANS 


Setting, Ranking and Reviewing 
Long-Term Operational Objectives 


Has the department set operational objectives at appropriate 
departmental and organizational unit levels? 


Have long-term objectives been set according to priority? 
Does the department systematically review these objectives? 
Are these objectives compatible with strategic objectives? 


Identifying Alternative Long-Term Operational 
Plans and Assessing the Costs and Benefits 


Are alternative long-term operational plans developed at the 
appropriate organizational levels? 


Are costs and benefits of these alternatives assessed? 
Are responsibilities for unforeseen events made explicit? 


Are alternative means of dealing with them identified and 
assessed? 


Developing, Approving and Reviewing Long-term 
Operational Plans 


Are there identifiable processes for long-term operational 
planning? 


Are they prepared and documented? 
Do the plans identify: 


What is to be done to accomplish the long-term objective? 
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The resources that will be required to execute them? 

When and by whom work is to be accomplished? 

The necessary means and criteria for monitoring performance? 
Are the plans reviewed and modified if necessary? 

Is there a formal review and approval process? 


Are revisions made according to program forecast decisions 
taken by the Treasury Board? 


Is there an effective link to the budgetary process through 
the Program Forecast? 


Communicating Long-Term Operational Objectives, 


Priorities, Resource Guide-lines and Plans 
Are departmental long-term operational objectives, priori- 


ties, resource guidelines and plans communicated to persons 
affected by it? 


Are responsibilities assigned for the execution of long-term 
operational plans? 


Management of the Long-Term Operational Planning Function 


Are the roles and responsibilities for long-term operational 
planning, including contingency planning, defined and assigned? 


Are those individuals responsible for the execution involved 
in the development? 


Where an exclusively dedicated staff is doing long-term 
operational planning, what is its size? 


= person years 


> $ 
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2020 71 OA rate tart performs operational planning along with 


other responsibilities, what portion is devoted to operational 
planning? 


oe person years 


3 $ 
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CURRENT YEAR OPERATIONAL PLANS 


The following section of the questionnaire concerns current- 
year operational planning. Sub-section 3.3 dealing with the 
development, approval and review of current-year operational 
plans, contains a series of questions related to performance 
information contained in item 3.3.6. These questions are 
grouped together under the headings of effectiveness, effi- 
ciency, level of service and quality. Since these questions 
are general ones, it may be desirable to elaborate on them 
in some instances. Annex A contains a series of specific 
back-up questions which may be used for this purpose. 


Setting, Ranking and Reviewing 


Current Year Operational Objectives 


Does the department have a well-defined set of current year 
operational objectives at suitable organizational levels? 


Are operational objectives defined as precisely as possible 
in terms of results desired in order to permit alternative 


considerations? 


Are current year operational objectives set according to 
priority? 


Is there a systematic review? 


Are current year operational objectives compatible with 
long-term operational objectives? 


Identifying Alternative Current-Year Operational 
Plans and Assessing their Costs and Benefits 


Are alternatives examined? 
Are costs and benefits assessed for the various alternatives? 


Is information appropriate to operational planning maintained? 
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3.3 Developing and Approving Current-Year Operational Plans 

3:34 Âre current-year operational plans developed according to a 
documented set of procedures? 

3.996 Are they documented? 

a ee aes Do the plans identify when and by whom the work is to be 
accomplished? 

3.3.8 Is there a formal review and approval process? 

3.3.4 Are current-year operational plans effectively linked to the 
budgetary process through the Estimates? 

329% Have contingency or emergency operations been taken into 
account in developing these plans? 

32.306 Do current year operational plans specify the levels of 
performance to be attained in terms of effectiveness, effi- 
ciency, quality and level of service considerations as 
appropriate? 

EFFECTIVENESS 

SN OL Do plans specify the levels of effectiveness to be attained? 

ER i owed Are the effectiveness measures representative of the objec- 
tives of plans? 

O53 6143 Are there external factors which must be taken into account 
in accomplishment of the planned (e.g. impact of changes in 
unemployment level on job placement) measures established 
for external factors (e.g. unemployment level) which impact 
on the program? 

373.004 Are qualitative measures established where quantitative mea- 
sures are not feasible? 

EFFICIENCY 

3.3.6.5 Are planned outputs representative of work performed, i.e. 


based on some characteristic of the work that accounts for 
changes in resource requirements? 
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3.3.6.6 Have the outputs been related to responsibility centres and 
to programs/activities? 


36.621 Where there is more than one organizational unit producing 
the same outputs, (e.g. regional operations) are there 
procedures in place which allow for comparisons to be made 
between these units? 

3.3.6.8 Has the measurability of the outputs been determined 
(e.g. process-type: regular, repetitive and homogeneous. 
project type: one of a kind projects generally)? 

355.629 Can outputs be forecast with adequate accuracy? The accuracy 
of the output forecast will determine the accuracy of re- 


source forecast. 


3.3.6.10 Are outputs of goods and services where possible reasonably 
allocated to consumers? 


(a) target population (final outputs)? 

(b) other responsibility centres? 

(c) other activities? 

(d) other programs? 

(e) other departments (in cases of centralized services)? 


3.3.6.11 Have all inputs been identified and are they properly docu- 
mented? 


3.3.6.12 Are the factors affecting workload for forecasting purposes 
reviewed periodically? 


3.3.6.13 Are factors such as the following taken into consideration 
in order to establish target efficiency levels: 


representativeness of present workload in terms of 
future demands 
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effects due to economies of scale 
ratio of overtime to regular-time 
ratio of absentees to staff-years 
absenteeism trends for permanent and temporary staff 


percentage of workforce scheduled for retirement in 
next year 


effect of employee turnover rates 
effect of significant departmental moves 
training plans 


LEVEL OF SERVICE 


3.3.6.14 Have service level specifications been developed and commu- 
nicated to the right individuals? 


3.3.6.15 Have the tollowing factors been considered where appropriate 
in developing service indicators? 


- response or elapsed time 

+ backlogs 

= error rate 

= waiting time or delay 

2 availability and accessibility of service 

vd penetration and participation rates 

. utilization of facility or service provided 

= consistency; i.e. percentage of occasions when service 
was delivered at prescribed standards. 


3.3.6.16 Have methods and benchmarks for monitoring client reactions 
been established in the plan? 
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QUALITY 


.3.6.17 Have quality specifications been established for outputs? 
.3.6.18 Have quality specifications been set according to priority? 


.3.6.19 Are procedures in place to permit changing quality speci- 
fications? 


327 Are emergency or contingency plans developed and responsi- 
bilities for them assigned? 


Ae aris & If so, have the assumptions on which these plans are based 
been made explicit? e.g. 


warning time 

maximum possible reaction time 

probable duration 

likely frequency 

international involvement 

other departmental or jurisdictional involvement 
health and safety hazards to departmental or other 
persons 

resource availability 

training needs. 


4 Communicating Current-Year Operational Objectives, Priori- 
ties, Resource Guidelines and Plans 

on ea Have departmental current-year operational objectives, 

priorities, resource guidelines and plans been communicated 

in writing to all persons affected by the plans? 


47 Has the responsibility for the execution of current-year 
operational plans been assigned? 


.4.3 Are responsibilities for the execution of emergency or 
contingency plans assigned? 
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3.4.4 Do the organization units responsible for the coordination 
of operational plans receive appropriate information from 
other organizational units (operations, policy, etc.) and 


are these groups aware of what is going on so that they can 
anticipate workload? 
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ANNEXE "A" 


EFFICIENCY 
OUTPUTS 
Le Is efficiency reported on both an aggregate and individual basis 


by program, function, activity or responsibility centre? 


2: Are the factors which influence the volume of program output 
reported? Examples: 


internal factors attributable to an operation (surplus or 
shortage of resources) 


external factors arising outside the operation (increase or 
decrease in demand) 


de Are output weights monitored periodically in order to adjust them 
when there is significant deviations from base year weights 


coupled with significant shifts in output mix? 


4. Are there procedures for rebasing (shifting the base year to the 
year when new outputs are added or subtracted)? 


26 Are outputs specified in such a way as to avoid double-counting? 


6. Are the methods used for aggregation consistent from one year to 
the next; if not, are there appropriate linkages? 


is Is aggregate output reported separately for discretionary and 
non-discretionary operations? 


INPUTS 


8. In selecting the method of allocating inputs, have the following 
factors been considered? 
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(a) degree of accuracy required 
(b) complexity of the method 
(c) availability and type of input data 


Have suitable methods, such as the following, been used to allo- 
cate inputs to outputs within individual organizational units? 


(a) allocation by time reporting 
(b) work standards 

(c) regression analysis 

(d) management estimates. 

Have inputs been subdivided by: 
(a) process-type 

(b) project-type 

(c) overhead? 


Has an appropriate method of assigning weights to different 
outputs been used? Examples: 


(a) base year unit cost 

(b) standards 

(c) estimates 

(d) multiple regression. 

Where there is more than one output for a responsibility centre, 
program or activity, is there a procedure available for combining 


(aggregating) these diverse outputs? 


If more than one type of goods and services are produced, are 
inputs allocated to either individual outputs or aggregate outputs? 
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Is the base year identical for all responsibility centres, pro- 
grams, activities or functions being aggregated? 


QUALITY 


Have quality specifications been established for components of 
production? 


Are quality specifications tested against process capability? 
Is quality controlled during the production process? 

Is quality controlled by sampling the process? 

Is quality controlled by sampling the final output? 


Does the sampling plan take into account producer and consumer 
risks? 


Are risk levels established for all sampling plans used? 


Are sampling criteria revised when desired levels of quality are 
attained? 


Are quality trends continuously reported? 
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Area I - PLANNING 
Item 4 - Current Year Operating Budgets 


A budget in government serves three main purposes. The 

first is to determine the financial and other resources 
required to carry out the plans of responsibility centre 
managers; the second is to obtain Treasury Board and parlia- 
mentary approval of departmental programs and resource 
requirements; the third is to provide the basis for budgetary 
control by stating management's plans in definitive quanti- 
tative terms. 


The Planning, Programming and Budgeting Guide sets out the 
concepts and aims of the system; the Program Forecast and 
Estimates Manual describes in greater detail the annual 
budgetary process and the form in which the program forecast 
and main estimates are required to be prepared by depart- 
ments. 


The questions under this item deal with the process of 
preparing current year operating budgets by responsibility 
centre managers to provide a basis for allocating funds to 
the managers and a basis for budgetary control. These 
detailed budgets can provide the basis for Main Estimates, 
although it is often preferable to prepare detailed budgets 
later in the year when the current year's results are more 
completely known and operational plans can be developed with 
more precision. 


An operating budget is management's plans for achieving 
objectives, expressed in quantitative terms, covering a 
specified period of time. The primary objective of an 
operating budget is to enable managers to manage more effec- 
tively. The process of arriving at a budget is essentially 
one of negotiation between the managers of responsibility 
centres and their superiors. The end product of these 
negotiations is a statement of the results, in relation to 
objectives, expected during the budget year and the re- 
sources that are to be used in achieving these results. 
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The agreed upon budget represents a bilateral commitment. 
Responsibility centre managers commit themselves to produce 
the planned results with the agreed resources, and their 
Superiors commit themselves that such performance is satisfac- 
tory. Both commitments are subject to the qualification 
"unless circumstances change significantly". 
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CURRENT-YEAR OPERATING BUDGETS 


Establishment of Responsibilities 


Are the roles and responsibilities of Planning and Finance 
clearly defined? (See Section 5 and 6.1.6) 


Are the responsibilities of operational managers and finan- 
cial officers vis-a-vis planning and budgeting clearly and 
appropriately identified? (See Section 3 and 6.2.6) 


Do responsibility centre managers have budget responsibility 
which is commensurate with their operational responsibility? 


Is the authority to spend from his budget restricted to the 
responsibility centre manager; if not, is his concurrence 
required? (See 7.8.2) 


Documentation and Communication 

Does the budget reflect the priorities and guidelines estab- 
lished by the executive committee and communicated to respon- 
sibility centre managers? (See Section 2 and 3) 

Has the budget cycle been documented and communicated so 

that all levels of management involved in budgeting are 

aware of the cycle and have sufficient notice of the dead- 
lines in order to ensure adequate time is spent on opera- 


tional budgeting? (See 6.2.6) 


Is a budget preparation directive issued to managers assigned 
budgetary responsibility which includes: 


= time deadlines for preparing budgets 


Ge dollar and person year guidelines on budgets 
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i guidelines on arriving at levels of proposed results 
for each activity element planned, consistent with 
decisions made during the Program Forecast and Esti- 
mates processes 


as instructions for converting operational work plans into 
budgets 


- standard budget worksheets 


- ‘unit costs for each activity element based on analysis 
Or: 


- previous year's costs 

- variables related to volume 
Ai projections of price changes 
- work measurement 


= methods for determining minimum costs by object of 
expenditure 


= instructions for dealing with variances from program 
average unit costs? 


Is there a consistent approach in the preparation of oper- 
ating budgets for various programs? 


Managerial Commitment 


Is there specific direction that managers with budgetary 
responsibility be involved in all aspects of the preparation 
of their budgets to ensure their commitment to the budgets? 
(See 6.2.6) 


Are managers following this direction? 
If operations are of the nature that some or all costs are 
considered to be outside of management control is there 


adequate segregation of costs according to the susceptibil- 
ity to control? 
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Are budgets prepared from the bottom up by responsibility 
centre managers in response to direction from the top down? 


Establishing Current Year Operating Budgets Based On Plans 


Do documented time phased operational work plans form the 
basis of operational budgets? 


Are budgets prepared in terms of expected results? 


Have activities been defined such that the costs of pursuing 
each objective and sub-objective of a program can be meaning- 
fully determined? 


Do the lowest level activity elements identify the basic 
processes or projects that contribute to the program objec- 
tives? 


Are these processes cr projects capable of being accurately 
costed? 


Is there a meaningful identifiable result for each process 
or project? (See Section 3) 


Are operating managers required to establish well-defined 
specific objectives and goals and develop time-phased work 
plans in relation to these objectives and goals as a basis 
for preparation of time phased operating budgets? 


Are the operational plans consistent with the annual objec- 
tives and plans established during the Estimates process? 
(See Section 3) 


Are there procedures for documenting and communicating 
objectives, goals, time-phased work plans as well as expected 
results in relation to budgets as a basis for analysis, 
corrective action and accountability? (See Section 3) 
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Where applicable, is statistical data accumulated or other- 
wise obtained for utilization as a data base in budget 
preparation? If not, should a data base be developed? (See 
Section 3) 


Are funds within the department fully allocated to the 
appropriate departmental level, with no free reserves main- 
tained? 


If reserves are maintained are they intended for emergencies? 


Are the types of emergency situations, for which the reserve 
was established, identified and documented? 


Is there historical data to justify the over-budgeting 
rationale and percentages used for over-budgeting practices 
in the department (i.e. allowing aggregate responsibility 
budgets to exceed the Main Estimate breakdown in the expec- 
tation that some responsibility centres will lapse with 
respect to their own budgets)? 


Review and Approval 


Are budgets approved at all appropriate levels of management 
within a department to ensure plans are complete, forecast 
workloads realistic, and standards attainable and comparable 
to other centres considering differing conditions? 


Are there procedures for the review of responsibility centre 
budgets by higher level managers and their financial officers 
which include: 


verification of all computations 


= comparison of unit costs to program averages for other 
responsibility centres 


= verification of minimum resource requirements 


= review of justification for variances from average unit 
costs or for not complying with other guidelines 
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ie assessment of impact on program objectives of changes 
in planned outputs from outputs given in budget guide- 
lines | 


= assessment of planned changes in inventory levels 


= comparison of aggregate program costs with program 
ceilings 


- assessment of budget implications for support services? 


Is there evidence of review of budgets by all appropriate 
levels of management? 


Are budget decisions by higher ievel management adequately 
explained and justified to lower level operating managers? 


Are responsibility centre budgets adjusted appropriately 
during the year where there are: 


- major changes in operational plans 
unforeseen price changes 


> changes in level of output? 
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Area 2 - ORGANIZING AND IMPLEMENTING 


Area 2, Organizing and Implementing examines the extent to which 
departments have organizational structures and relationships in place 
to enable them to perform the planning, controlling and audit activi- 
ties highlighted in Areas 1, 3 and 4. It is the objective of the 
survey to identify functional organization structures and responsibil- 
ities for Areas 1, 3 and 4; to examine the linkages both within func- 
tions and between functional groups; and to determine whether depart- 
ments have sufficient and appropriately qualified staff to undertake 
essential management control responsibilities. 
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Area 2 - ORGANIZING AND IMPLEMENTING 


ITEM 5 


Organizational Relationships and Control Structures 


The questions in this item are aimed at determining the 
extent to which organizational relationships and con- 
trol structures exist in departments for effective 
financial management and the directly related activi- 
ties of operational planning and control upon which 
financial functions depend. IMPAC identifies planning, 
financial management, performance measurement, program 
evaluation and internal audit as the key functional 
contributors in the control of departmental activities. 


All of these functions have to be established within 
the department and responsibilities and authorities for 
carrying out the tasks have to be appropriately assigned 
to specific persons. The tasks will in most cases be 
assigned to identifiable organizational units, for 
example, financial management and internal audit. For 
these types of functions, some common types of orga- 
nizational structures are found. In other instances, 
such as for performance measurement, the tasks can 
become a part of each manager's normal responsibili- 
ties; and specific structures are not prescribed. The 
important fact, however, is that responsibilities must 
be assigned to cover all of the functions mentioned 
above. 


Having established responsibility for each of these 
functions, it is critical that certain key linkages or 
"cross-overs" exist between functions to ensure con- 
tinuity of the management process. These functional 
linkages are required at various stages of activities 
such as in the preparation of departmental objectives, 
guidelines, Program Forecasts, Main Estimates, work 
plans, budgets and in the implementation of programs, 
control of operations, corrective actions and program 
evaluations. The main emphasis of this item is to 
ascertain the strength of these basic functional link- 
ages. 
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There are two additional subjects reviewed. One is the 
extent to which departments have appropriately trained 
staff to fulfill the above management functions. The 
other is whether all of the functional areas are using 
the same program/activity and responsibility centre 
structures as a common frame of reference. This may 
not be necessary for some special circumstances, but in 
most cases it is essential. 


In summary, the questions in this item encompass total 
organizational issues for effective management control, 
and hence, touch on all or most of the other items of 
IMPAC. Most of the items have questions relating to 
specific organizational issues; this item pulls together, 
analyzes and summarizes all of this information to 
ensure that all of the functions are present and appro- 
priately integrated to allow for an effective manage- 
ment control system. The answers to the general ques- 
tions of this item are therefore based upon analysis of 
related questions in other items. There are no new 
questions to be posed to the department. 


Finally a department should rely on the performance of 
its people more than on its technical structure and 
relationships. This type of survey, however, cannot be 
done within the current scope of IMPAC. 
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ORGANIZATIONAL RELATIONSHIPS AND CONTROL STRUCTURES* 


Organizational Structure and Responsibilities 


Do organizational focal points or structures exist in the 
department to carry out all the management functions out- 
lined in the IMPAC survey? Describe in general terms: 


planning 

financial management 
program evaluation 
internal audit. 


Have responsiblities and authorities for the above been 
suitably assigned to persons in the organization? 


Functional Linkages 


Do appropriate organizational linkages exist for the following 
management functions? 


strategic planning 

operational planning 

financial planning and budgeting 
financial administration 
performance analysis and control 
program evaluation 

liaison with support services. 


Has the department communicated the responsibilities of each 


of the management functions above to each of the other 
management functions and has it been understood? 


Staffing and Training 
Does the department have sufficient appropriately trained 


staff (and development programs) to fulfill the management 
functions reviewed in IMPAC? 
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Common Program/Activity and Responsibility 
Centre Framework 


Do detailed program/activity and responsibility centre 
structures exist for use as a common frame of reference for 


all of the functions listed above? 


Response to be drawn from analysis and summary of responses to 
specific questions already existing in the IMPAC questionnaire. 
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Area II - ORGANIZING AND IMPLEMENTING 


Item 6 - Management of the Financial Function 


This item focuses on the organizational arrangements 
and methods of communication which must exist within a 
department if financial responsibilities and authori- 
ties are to be adequately carried out. 


Many aspects of a system of financial control are the 
responsibility of operating managers who have been 
assigned authority to spend funds within an approved 
budget. Other responsibilities are assigned to support 
staff who provide functional advice or service but are 
not directly responsible for financial administration. 


To ensure that the system is designed and operated in 
an effective and efficient manner there must be a focal 
point within each department in the form of a senior 
financial officer with adequate staff support. 
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MANAGEMENT OF THE FINANCIAL FUNCTION 


Organization Structure and Responsibilities 


Has the deputy head designated a senior financial officer to 
be responsible for the departmental system of financial 
administration? 


Is the senior financial officer a member of the senior or 
the executive management committee? 


Does the senior financial officer have responsibities other 
than financial administration? 


*If so, please list functions and respective person years 
involved. 


(i) 
(ii) 
(iii) 
(iv) 
(v) 


Is there a senior full-time financial officer in the depart- 
ment? 


Does the financial organization have identifiable groups/ 
functions responsible for the following activities: 


= budgetary preparation and control (e.g. financial 
planning, departmental Estimates, appropriation and 
allotment control, responsibility centre budgetary 
system and variance analysis system. (See 4.1.1) 


= accounting and reporting systems (e.g. departmental 
financial reporting system and integration of depart- 
mental and central accounting systems) 


- financial controls and authorities (e.g. financial 


control of expenditures, revenue and accounts receiv- 
able) 
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+ departmental level financial services (e.g. a group 
responsible for servicing those central units of the 
department not serviced by program or field financial 
officers) 


- others (list)? 


What is the size (person years and $) of the financial 
administration function within the department? (Include the 
levels of the financial personnel and professional qualifi- 
cations where applicable.) 


Job Descriptions 


Are there job descriptions for all of the financial adminis- 
tration staff which adequately describe the duties to be 
performed? 


Are the existing job descriptions current? 


Are there procedures to ensure that job descriptions are 
kept up-to-date? 


Does the statement of duties of the senior departmental and, 
where applicable, senior branch financial officer include 
responsibility for: 


- advising the deputy head (or branch head) and his staff 
on the needs of the department in the area of financial 
administration 


- advising the deputy head (or branch head) of the finan- 
cial implications of decisions at the planning and 
operational stages 


- advising on the application of legislative, regulatory 
and other financial requirements of Parliament and 


central agencies 


- directing the design, communication and maintenance of 
systems of financial administration 


= providing guidance on the organization, staffing and 
training of financial units? 
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Functional Linkages 


Do the organization charts identify functional lines of 
authority and accountability between the financial function 
of the department level and that of the operational level? 


Do the statements of duties for financial officers identify 
and distinguish between their line and functional responsi- 
bilaties: 


- at the departmental level 
= at the program level 
= at the responsibility centre level? 


Is the documented concept of functional authority understood 
and adhered to within the department? 


Is there documentation on the financial administration 
responsibilities of responsibility centre managers? (For 
example, in budget preparation these responsibilities would 
include forecasting in relation to planned accomplishment 
and physical resources for which finances are required; in 
budgetary control the responsibilities would include ex- 
plaining the causes of significant variances between planned 
and actual costs in relation to outputs, and initiating 
appropriate action to obtain additional resources, reduce 
costs or increase efficiency in response to problems indi- 
cated by variances. See 4.1.2, 4.2.2eande473i11%) 


Communication of Financial Policy 


Is the department's Financial Administration Manual issued 
under the authority of the deputy head? 


Does the manual contain details of the department's systems 
for: 


5 management of the function 
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- classification of accounts 

oa budgetary preparation 

= budgetary control 

= financial reporting 

xs verification and payment of accounts 
= allotment control 

= commitment control 

- delegation of signing authorities 


o accounting and control of revenue and accounts receiv- 
able (See 8.1.1 and 8.1.2) 


= deletion of debts 

= accounting and control of grants 

= accounting, control and audit of contributions 

- . imprest accounts 

“ personnel and pay? 

Does the manual: 

- facilitate quick reference 

~ contain relevant and current information? 

Does the manual provide for the insertion of directives, 
instructions, circular letters etc., issued by branches and 
regions to meet specific requirements of individual pro- 
grams, etc.? 

Are there procedures to ensure that the manual is kept 
up-to-date (including procedures for insertion of direc- 


tives, instructions or circular letters into the manual on a 
temporary basis, until decisions on amendments are made)? 
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Are the branch and regional supplementary manual insertions 
reviewed by the central financial organization to ensure 
compatability with departmental procedures? 


Does the senior financial officer approve all amendments to 
the manual? 


Staffing and Training 

Evaluation of Financial Officers 

Does the senior financial officer have a program for the 
review of performance evaluations of all financial officers 


in the department? 


Do responsibility centre managers regularly prepare evalua- 
tions on the performance of their financial officer(s)? 


Are these performance evaluation reports forwarded to the 
senior financial officer for review and concurrence? 


Training Program 


Does the department have a financial administration training 
plan for: 


+ financial officers and staff 
= operational managers and staff? 
Is the training plan documented? 


Is there any rotation of duties to provide back-up for 
critical or key positions in the financial organization? 


Does employee turnover (or lack of continuity) in critical 


or key positions in the financial organization appear to be 
a problem? 
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Area III - CONTROLLING 


Item 7 - 


Expenditures 


This item covers the basic requirements for effective systems 
of accounting, internal control and delegation of financial 
authorities. 


At the minimum these systems must satisfy the requirements 
of the Financial Administration Act, the policies and regula- 


tions of Treasury Board, and the requirements of the Receiver 
General. 


As well, the questions are designed to assess the capability 
of the systems to meet the requirements for information set 
forth in items 9 and 12. 
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EXPENDITURES 


Accounting 


Is the principal accounting system used in the department 
for expenditures documented? (See 6.3.7 - 6.3.16) 


Are there procedures requiring reconciliation of this prin- 
cipal accounting system to the central accounts of Canada? 


Does the principal accounting system or any subsidiary 
systems controlled by it represent the sole source of finan- 
cial information? 

Are all non-financial data on financial reports controlled 


by a single responsibility point to ensure its accuracy and 
comparability with financial data? (See 9.2.13) 


Integration of Subsidiary Accounting Systems 

Are there procedures for the input and reconciliation of 
financial information in the following subsidiary systems to 
control accounts in the principal accounting system: 

- inventories of materials and supplies 

- inventories of work in progress 

= inventories of equipment 

= other fixed assets 

- payroll distribution 

- cost distribution 


- other? (provide details) 


Are the subsidiary accounting systems in 7.2.1 - 7.2.7 
documented? 
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Accounting and Reporting Services 


Is detailed accounting information for input to the depart- 
ment's principal accounting system obtained as a by-product 


of the recording of cash disbursement transactions? 


Where the design of the accounting system provides for the 
use of one or more service organizations are there proce- 
dures requiring written agreement with each service organi- 
zation which specifies: 


= the services to be provided 


- the responsibilities assumed by the service organiza- 
tion for accounting and internal control? 


Does the agreement specify the rights of the department to 
obtain information on: 


= the design and operation of the systems operated on its 
behalf by the service organization 


= any amendments made to these systems 

- the results of independent audits of these systems? 
Does the department have documented procedures for the 
periodic review of adherence to, and adequacy of, agreements 


with service organizations? 


Does the department have a procedure for monitoring the 
quality of the service provided by the service organization? 


Timing of Accounting Entries 


After payment authority has been exercised, is there a 
requirement for payment requisitions to be forwarded di- 
rectly without delay to Services offices of the Department 
of Supply and Services? 


Are there procedures for the periodic input of undischarged 
commitments to the accounting system? 
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Are there procedures to identify the types and amounts of 
accruals which are necessary to satisfy: 


= needs for cost information 
= needs for inventory control? 
Do these procedures covering accrual accounting provide for: 


= entry of invoices paid after closing date of cheque 
issue 


* entry of invoices received but not paid for after 
closing date of cheque issue 


- entry of estimates for goods or services received but 
for which invoices have not been received 


- other entries to adjust cost or revenues for the period? 


Accounting for Inventories of Materials and Supplies, 


Equipment and Other Fixed Assets 


Are there guidelines which identify when independent control 
of inventories is required: 


= by means of detailed records 
= by means of control accounts? 


Are the procedures documented for maintaining detailed 
inventory records and control accounts? 


Are there procedures for physical stocktaking and comparing 
the count to the book record? 
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Accounting Controls 


Does the documentation of the accounting system identify the 
following types of accounting controls wherever they occur: 


= numerical sequence controls 

= control totals 

a batch controls 

= repetitive checking 

= reasonability controls 

= statistical sampling 

- other controls? (specify) 

Are there procedures requiring that the approval of a des- 
ignated officer be obtained for any changes in the applica- 
tion of accounting controls? 

Are there procedures whereby all employees provide evidence 
that they have exercised the accounting controls for which 


they are responsible by signing or initialling accounting 
documents? 


Coding System 


Are there instructions explaining the use of the various 
fields of the coding block? 


Does the coding system include collator codes? 
Are there procedures for the circulation of codes and coding 


instructions to all responsibility centres and financial 
staff? 
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Delegation of Financial Signing Authorities 


Are the principles of delegated financial signing authori- 
ties and the responsibilities involved explained in writing 
to managers who have been delegated signing authority? 


Is spending authority delegated to supervisory and responsi- 
bility centre managers only in respect of their own budgets 
and those of their subordinates? (See 4.1.4) 


When spending authority is granted to officers other than 
supervisory and responsibility centre managers, does the 
delegation document make clear that these officers are exer- 
cising this authority on behalf of managers with budgetary 
responsibility? 


Is payment authority delegated only to financial or other 
independent officers? 


Is authority to give commitment certificates granted to 
either managers with spending authority or officers with 
payment authority and not to both in respect to any specific 
allotment? 


Are there requirements that: 


= spending authority and payment authority not be exer- 
cised by the same person for a particular payment 


= payment authority not be exercised until any certifi- 
cate required under Section 27 of the Act has been 
provided 


is authorities be delegated to organizational positions 
and not to individuals 


“= authorities not be exercised by persons assuming opera- 
tional responsibilities of a superior unless they are 
designated in writing by appropriate persons to perform 
the duties of the position on a temporary basis? 


Is payment authority delegated only to positions classified 
at or above the FI-2 level or its equivalent? 


Are there instructions that no person is to exercise either 


payment or spending authority with respect to a payment from 
which he can personally benefit? 
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Documentation and Communication of Delegated Authorities 


Is the formal delegation document in a form that is conve- 
nient for distribution to and use by all persons who must 
give recognition to financial authorities? 


Are specimen signature cards distributed to all personnel 
who have to recognize a financial signing authority both in 
the department and in cheque-issuing offices of the Depart- 
ment of Supply and Services? 


Are there procedures for the annual review and up-date of 


all delegated signing authorities and specimen signature 
cards? 


Regulations and Directives 


Are there procedures to be followed by officers with spending 
authority and payment authority which: 


Fe comply with all requirements of the Account Verifica- 
tion and Payment Requisition Regulations 


= detail the respective responsibilities of the officers 
to ensure compliance with the Account Verification and 
Payment Requisition Regulations? 


Are there procedures for: 


= the operation of departmental bank accounts which 
comply with Part II of the Cheque Issue Regulations 


= the assignment of debts which comply with the Assigned 
Debt and Power of Attorney Payment Regulations? 


Verification Procedures 


Are there adequate control procedures over expenditures 
being used in the department and have they been documented 
and communicated to all interested parties? 


Have the control procedures over the EDP portion of the 


expenditure accounting process in use in the department been 
documented and communicated to all interested parties? 
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Distribution of Receiver General Cheques 


Are all Receiver General cheques being requested from DSS of 
the classes approved under Treasury Board's directives? 


Is there an adequate internal control system in use in the 
department over the approved classes of cheques being re- 
quested from DSS? 


Personnel and Pay 


Does the department use adequate personnel and pay control 
procedures which are documented and which will ensure that: 


= pay vouchers are properly prepared, properly authorized 
and promptly processed 


- departmental and government-wide regulations and in- 
structions relating to pay allowances are being com- 


plied with 

- the internal controls built into the system are suffi- 
cient to prevent fraud and detect errors and are effec- 
tive 


= the rates of pay, etc. provided in the departmental and 
Treasury Board Regulations and directives are being 
consistently applied 


= individual personnel pay and leave records are main- 
tained? 


Are there adequate control procedures over the EDP portion 
of the payroll accounting process in the department? 


Have the control procedures over the EDP portion been docu- 
mented and communicated to interested parties? 


Cash Control 
General 


Are the following cash control systems documented: 


January 1979 


LA: 


.14. 


.14. 


.14. 


Las 


14. 


.14. 


.l4. 


.l4. 


A re 


114 


10 


oF 


- appropriation, allotment and sub-allotment control 
“ cash forecasting 
= commitment control? 


Is the system for controlling responsibility centre budgets 
documented? 


Appropriation and Allotment Control 
Are there procedures for: 


= maintenance of control accounts for Treasury Board 
prescribed allotments? 


€ maintenance of allotment control accounts during periods 
of interim supply or for special Governor General's 


warrants? 


Does the appropriation and allotment control system prohibit 
over-expenditure of allotments? 


Are there procedures to ensure that payment for goods or 
services received on or before March 3lst are charged to the 
proper fiscal year? 

Sub-allotment Control 

Are there procedures for: 

- maintenance of sub-allotment control accounts where 
payment authority is delegated to officers on a decen- 
tralized basis? 

= preparation of cash forecasts? 

Is the cash forecasting system based on time-phased finan- 

cial budgets? (both cash forecasts for departmental pur- 


poses and those prepared for Department of Finance). 


Are the cash forecasts regularly updated to reflect: 
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> changes in operational plans 
= price changes 

a changes in asset levels? 
Commitment Control 


Are the types of transactions that are required to be committed 
specified? 


Are there procedures for: 


- use of records of undischarged commitments at each 
responsibility centre 


- maintenance of a continuous record of commitments for: 
(i) capital projects 
(ii) grants or contributions 
(iii) future year expenditures of all types? 


- centralized reporting of commitments by responsibility 
centres: 


(i) monthly throughout the year 


(ii) more frequently if required by the officers with 
payment authority? 


5 regular review of outstanding commitments to determine 


that they are still valid and identified with the 
correct fiscal year? 
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Area III - CONTROLLING 
Item 8 - Non-tax Revenues and Accounts Receivable 


This item covers the responsibilities of departments to 
claim revenues at realistic rates wherever appropriate; 
to control claims outstanding; to utilize adequate 
collection procedures; and to ensure that when monies 


are received they are adequately safeguarded and accounted 
for. 
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NON-TAX REVENUES AND ACCOUNTS RECEIVABLE 


General 


Are the departmental policies for non-tax revenue and accounts 
receivable documented? 


Is the system used for accounting and control of revenue, 
cash receipts, accounts receivable, loans and advances 
documented? 


Does the system for accounting and control of revenue, cash 
receipts, accounts receivable, loans and advances provide 
for an adequate segregation of duties of individuals? 


Examination of Revenue Policy 


Has the department identified all departmental programs or 
activities which could produce revenue on a cost effective 
basis when it is supplying goods or rendering services to 
the public? 


Has the department identified all statutory and other regu- 
latory requirements with respect to any of the department's 
non-tax revenues and are there adequate procedures to ensure 
compliance with such requirements? 


Where the department is supplying goods or rendering ser- 
vices to the public without charge, has the department 
documented its rationale? 


When goods or services are being provided to the public, 
does the department annually review the rates to determine 
whether fees should be introduced or adjusted? 


Does the department periodically undertake a cost/benefit 
analysis of the administration required to bill and collect 
various revenues? 


If the Treasury Board sets rates for revenue-producing 
activities, does the department provide Treasury Board with 
cost information sufficient to determine appropriate rates 
and price structures? 
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If the Department sets rates for revenue-producing activi- 
ties, has a detailed rate proposal been provided to and 
approved by the Treasury Board? 


Does the price for goods or services include direct and 
indirect costs? 


Claiming Revenue 


Are the systems and procedures for the initiation of revenue 
fully documented in departmental manuals? 


Is there a departmental policy on the granting of credit? 
Are invoices properly completed and recorded? 

Are the following adequately recorded and controlled: 

= revenue from cash sales 

= revenue from credit sales 

= credit notes 

- sales from inventory? 


Receipt and Deposit of Revenues and Receipts 


Do the departmental manuals and directives fully explain the 
departmental policy and procedures for the receipt, recording, 
control and deposit of: 

~ cash receipts 

~ Interdepartmental Settlement Advices? 

Are there procedures for the control of post-dated cheques? 

Do the procedures for the receipt and deposit of money 


comply with the Receipt and Deposit of Public Money Regu- 
lations? 
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Control Over Accounts Receivable 

Do the departmental manuals and directives fully describe 
the policy and procedures for the recording and balancing of 
accounts receivable records? 


Are there procedures for collecting receivables which include: 


- indentification of overdue accounts through procedures 
such as aging analysis 


- collection action considered feasible in particular 
circumstances 


= examination of overdue accounts by a senior official 


- action to recommend deletion of uncollectable accounts 
which comply with the Deletion of Debts Regulations 


Loans and Advances 

Are there procedures to ensure that loans and advances are 
authorized in accordance with the enabling legislation or 
regulation? 

Are there procedures for reconciling total outstanding loans 
and advances in departmental records with central account 


balances for loans and advances? 


Are there procedures for claiming and collecting installment 
payments and interest when due? 


Other Areas 


Are there procedures for: 


the repayment of receipts which comply with the Repayment of 
Receipts Regulations? 


the handling of dishonoured cheques which will help ensure 
the recovery of funds? 
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APR Ate) reporting and recovering losses arising out of defalcations 


by government employees and which comply with the Public 


Officers Guarantee Regulations? 


8.7.4 the operation of trust accounts which comply with the 
Revenue Trust Account Regulations? 


January 1979 


Area III - CONTROLLING 


Item 9 


Financial Information Systems 


The classification of accounts determines the manner in 
which financial data are identified, aggregated and 
reported for purposes of planning, resource allocation, 
management control and results evaluation. 


The classification system should be designed to handle 
information on a planned and actual basis consistent 
with the current year operational plans of management. 
As such, a threefold classification structure should be 
utilized which identifies: 


= the projects or processes carried out to attain 
program objectives (activity elements) 


= who is responsible and accountable (responsibility 
centres) 


= the nature of the items on which expenditures are 
made (reporting objects) 


Financial information is utilized for both cash control 
over appropriations and allotments and managerial 
control through a budget system; two distinct yet 
related purposes. Managerial control through a budget 
system requires that each manager has an agreed time- 
phased plan and that he accounts for his actions in 
relation to plans on a periodic basis. Such a system 
requires periodic and consistent reporting of actual 
results in relation to management's operational plans. 
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FINANCIAL INFORMATION SYSTEMS 


Establishment of a Coding and Classification Structure 
Does the account structure include classification by: 

- input (object of expenditure) 

= responsibility (responsibility centre), and 

- results (activity elements, projects or processes)? 


Does the coding structure enable financial data to be iden- 
tified, aggregated and reported on a program activity basis 
which is consistent with the manner in which the department 
develops plans and builds up budgets? (See Section 3 and 4) 


Does the classification system descend to activity elements 
which identify the costs of the lowest level processes or 
projects which are carried out to attain a program's objec- 
tives? 


Could the program activity structure be improved to provide 
a better basis for reporting in relation to specific objec- 


tives? 


Does the classification system require that each activity 
element have an identifiable output where appropriate? 


Does the responsibility structure correspond to: 
7 the delegation of authority 


= the lines of authority shown on departmental organiza- 
tion charts? 


Does the classification system provide for identifying cost 
centres where necessary within a responsibility centre? 


Does the account structure adequately identify resource 
inputs through a comprehensive departmental object of expen- 
diture classification? 


Does the object of expenditure structure identify depart- 


mental objects which are capable of being aggregated or 
related to: 
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= departmental reporting objects 


co reporting objects and standard objects designated by 
Treasury Board 


= economic objectives required for governmental statistical 
purposes? 


Does the revenue structure identify departmental objects 
which are capable of being aggregated or related to: 


= departmental reporting objects 


= reporting objects and standard objects designated by 
Treasury Board 


= economic objects required for governmental statistical 
purposes? 


Does the classification system provide for setting up in 
departmental accounts those assets and liabilities reported 
in the Statement of Assets and Liabilities of the Government 
of Canada? 


Does the classification system provide for setting up in 
departmental accounts those assets and liabilities not 
normally reported in the Statement of Assets and Liabilities 
of the Government of Canada? 


Usefulness and Content of Financial 
Management Control Reports 


Do financial reports identify and aggregate information on a 
basis which reflects the manner in which the department 
develops plans and builds up budgets? 


Do the reports clearly identify the manager accountable and 


the extent of the responsibility (i.e., manager's title, 
area of responsibility and period covered)? 
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Are managers presented with financial information prepared 
so as to highlight significant exceptions from planned 
utilization of resources or results? 


Are actual results compared to planned objectives and stan- 
dards? 


Does each senior manager have appropriately detailed infor- 
mation available to meaningfully monitor the performance of 
his or her subordinates, i.e. does he or she monitor more 
than just the aggregate expenditures and budget of subordi- 
nates? 


Is there adequate communication between financial officers 
and operating managers to ensure that reports are responsive 


to changing needs of operating managers? 


Do financial management reports for responsibility centres 
include details of: 


= budgeted costs by activity elements on a periodic basis 
4 actual costs by activity elements 


= planned operational results by activity elements on a 
periodic basis (See Section 10) 


zi actual operational results by activity elements (See 
Section 10) 


- budgeted resource costs by reporting objects on a 
periodic basis 


bs actual resource costs by reporting object? 
Do the reports contain operational data presented in a 
manner which can be readily related and identified with the 


financial data? (See 7.1.4) 


Does the reporting system ‘roll up' information for reports 
to: 


= supervisory managers (by activity element, responsi- 
bility centre and reporting object)? 
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5 staff advisers responsible for activities, sub- 
activities, activity elements etc? 


Is there an appropriate basis for identifying and allocating 
between activities: 


= direct costs 

= inhi reat costs 

Se common services costs? 

Do financial reports include a meaningful and appropriate 
breakdown of financial data in terms of relevant operational 
data such as: 

- results and performance (See Section 10) 

= person hours and person days consumed 

= quantities of other resources consumed? 

Are reporting systems and reports designed so that the 


information is as complete as possible and there is no 
unnecessary duplication? 


Timeliness and Accuracy of Financial Management Reports 


Is the information in financial reports sufficiently accurate 
and current for decision-making and management control 
purposes? 


Are the reports received in sufficient time for corrective 
and preventive action to be taken? 


Usefulness and Contents of Cash Control Reports 


Does the reporting system require preparation of reports for 
financial officers with details by: 


- appropriation 


- allotment 
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i sub-allotment? 

Do the reports include: 

= disbursements 

- undischarged commitments 
= free balances? 


Does the reporting system restrict regular distribution of 
detailed transaction listings to financial staff only? 


Timeliness and Accuracy of Cash Reports 
Do cash reports accurately reflect the cash position? 


Are the reports received in sufficient time for corrective 
and preventive action to. be taken? 
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LOS Operational Information Systems and Performance Measurement 


Items 3 and 4 of the Planning Area examined the adequacy 
with which operational plans and budgets specified the results and 
associated costs and revenues anticipated during the current year. 
Items 9 and 10 (sub-items 10.1 to 10.3) examine the means used to 
collect and report on both actual results and costs and revenues as 
well as comparisons between actual and intended results. Section 12 
examines the analysis for corrective action of the planned and actual 
results. 


The questions in this item are also designed to permit an 
assessment of the organizational provisions made to implement the 
Treasury Board's Performance Measurement policy (sub-items 10.4 to 
10.6). The broad nature of the questions recognizes departmental and 
agency prerogatives to select the path of organizational development 
best suited to their particular environments, yet is intended to 
identify the stage of organizational evolution that has been reached. 
This will be done by ascertaining whether or not basic provisions have 
been made for establishing and communicating responsibilities and 
relationships, as well as by looking for essential linkages with 
management and other functional groups. 
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OPERATIONAL INFORMATION SYSTEMS AND PERFORMANCE MEASUREMENT 


Establishing Information Needs and Structures 

Have managers at all levels specified the type and frequency 
of the information necessary to monitor performance in 
aa operational plans within their areas of respon- 
sibility? 

Is information provided, as appropriate, on: 

S quantity of goods and services produced 

oA quality of goods and services produced 

= level of services provided 


3 resources used in producing the goods and services 


= the extent to which operational objectives are being 
achieved 


- the relationships (e.g. unit costs, efficiency indexes) 
between the goods and services provided and the costs 


of inputs used in their production? 


Have these managers specified the integration they require 
of performance and financial information? 


Have appropriate means been developed to provide the required 


information, e.g. computer reports, programs, etc.? 


Do these means provide comparisons between actual and planned 
input, output, efficiency, effectiveness, quality and level 
of service? 


What percentage of EDP systems development effort is expended 
on development of management, including financial, control 
systems? What is the total EDP systems development effort? 
($ and person years) 
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What percentage of EDP systems operating time is expended on 
running such systems? What is the total number of hours of 
EDP operating time per month? 


Have performance information systems been documented? 


Does the procedure specify the appropriate individuals 
within the department to whom performance information is to 
be communicated? 


Where exception reporting is used, have the criteria for 
exceptions been established? 


Does the performance reporting system provide for the peri- 
odical reporting of quality of goods and services provided 
by other government departments? 


Has appropriate assignment of responsibility to specific 
individuals been established within the department for the 
maintenance and coordination of performance information? 


Adequacy of Performance Information 


Do the performance measures (efficiency, effectiveness, 
quality and level of service) in use provide adequate and 
appropriate information for controlling all the major aspects 
of a department's performance? 


Does the control information provide, where appropriate, for 
a segregation between discretionary and non-discretionary 
outputs? 


non-discretionary: the nature, magnitude and timing are 
largely determined by external demand (e.g. volume of mail, 
number of tax-returns, applications for old age benefits, 
etc.); 


discretionary: the nature, magnitude and timing are largely 
determined by senior program management, (e.g. number of 
inspections of food plants, number of investigations of 
unemployment insurance beneficiaries, number of audits of 
tax-returns, etc.). 
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Are the effectiveness measures in use representative of the 
objectives of the program? 


Are there measures for external factors, (e.g. unemployment 
level) which impact on the program? 


Are qualitative measures of program effects used where 
quantitative measures are not feasible? 


Are output mixes known and monitored to determine the change 
in mix? 


Is there a means of monitoring the contribution of various 
organizational units to outputs? 


Are appropriate methods used to monitor changes in efficiency? 
For example: 


indexing changes from base year 

comparison of actual to standards 

comparison of actual to estimates 

for operations in various centres producing identical out- 
puts, use of actual ratio attained by one centre as a bench- 
mark for assessing others, or as an alternative, use of the 
average of all centres as a benchmark. 

taking economies of scale into account where applicable 

Are the differing information needs at the various levels of 
management taken into account in the performance information 


system? 


Is all of the information needed, i.e. is there an excess of 
information? 


Timeliness, Accuracy and Usefulness of Performance Information 


Is the information sufficiently accurate for its intended 
use? 


Is the performance information adequately reconcilable to 
the financial accounts for the operations? 
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For example, the use of the term "adequately" should reflect 
the degree of accuracy required by management. 


Are precise turn-around times specified for the provision of 
performance information? 


Is the performance information provided in time to be of 
significant use in the management decision-making process? 


Is the information available to appropriate levels of man- 
agement? 


Is the information in a form that is easily understood and 
that permits significant changes, trends or variances to be 


readily observed? 


Have the following factors been considered in designing 
reporting formats for operational reports? 


graphical - suitable for comparisons, summaries, indications 
of trends, 


tabular - suitable for analysis and for the presentation of 
more detailed and accurate information, 


narrative - necessary for the conveyance of information for 
explanations, interpretations, elaborations. 
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Organization Structure and Responsibility 


Has the responsibility for the implementation of the Treasury 
Board's Performance Measurement Policy been appropriately 
assigned? 


Have responsibilities been communicated to appropriate 
levels of management and staff? 


Has an appropriate plan been developed for the implementa- 
tion of Performance Measurement Policy? 


Have appropriate resources been allocated to the implemen- 
tation of Performance Measurement Policy? 


Functional Linkages 


Have functional responsibilities for performance measurement 
information been defined, and communicated, within the 
department or agency? 


Are functional responsibilities and relationships for per- 
formance measurement defined, communicated and reviewed 
within the department or agency? 


Are relevant external policy and guidelines relating to 
performance measurement appropriately communicated within 
the department or agency? 


Staffing and Training 


Are there appropriately qualified staff available to fulfill 
all assigned responsibilities for performance measurement 
within the department or agency? 


Have training and development requirements for managers and 
staffs relating to program performance measurement been 


established and provided? 


Have training and development requirements for managers and 
staff related to performance measurement been established? 
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Is training and development provided by: 

* departmental programs? 

" external programs? 

Have the educational needs and information requirements 


regarding program performance measurement been identified 
and met for managers and staff? 
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Is there monitoring of the program effects which can be 
measured? 


Are there measures for external. factors (e.g. unemployment 
level) which impact on the program? 


Are qualitative measures of program effects used where 
quantitive measures are not feasible? 


Have quality control procedures been established to monitor 
and maintain quality level in accordance with specifications 
or desired attributes? 


Have quality control procedures been related to level of 
service control procedures? 


Are there channels of communication available to clients or 
target population to express their satisfaction or dissatis- 
faction with services provided? If so, have clients been 
made aware of these channels? 


Are broad departmental objectives regarding level of service 
communicated to front line staffs? 
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PROGRAM EVALUATION 


This item is divided into two major sections: Orga- 
nizing, Planning and Resourcing for Program Evaluation, 
and Conduct and Use of Program Evaluations. The first 
section includes sub-items 11.1 to 11.5 while the 
second includes sub-items 11.6 to 11.8. 


Organizing, Planning and Resourcing for Program 
Evaluation 


The questions in this section are designed to permit an 
assessment of the provisions made to implement the 
Treasury Board's Program Evaluation policy. The broad 
nature of the questions recognizes departmental and 
agency prerogatives to select the path or organiza- 
tional development best suited to their particular 
needs, yet is intended to identify the stage of orga- 
nizational evolution that has been reached. This will 
be done by ascertaining whether or not basic provisions 
have been made for establishing and communicating 
responsibilities and relationships, as well as by 
looking for essential linkages with management and 
other functional groups. 


Assessments of the provisions made to implement the 
Program Evaluation policy will include a determination 
of the appropriateness of departmental program evalu- 
ation plans and the adequacy of evaluation resources 
for implementation and maintenance of such plans. 


Conduct and Use of Program Evaluations 
The purpose of this section is to determine the extent 


to which the department or agency is conducting and 
using program evaluations. 


The questions are aimed at determining the degree to 
which departmental program evaluation plans are imple- 
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mented, how the appropriate reporting and distribution 
of results is achieved and the extent to which pro- 
cesses have been established to ensure that the results 
of evaluations are analysed and used in terms of both 
current and longer term corrective action. 
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ORGANIZING, PLANNING AND RESOURCING FOR PROGRAM EVALUATION 


Organization Structure and Responsibility 


Is the organization of the program evaluation function 
adequate and appropriate within the department or agency? 


Is program evaluation a direct functional responsibility of 
the office of the deputy minister or head of agency? 


Has an individual (or individuals) been assigned coordinat- 
ing responsibilities for program evaluation throughout the 
organization? 


Does the assignment of responsibilities to the coordinator 
or senior evaluation officer include ensuring: 


= the development and maintenance of a departmental plan 
to review programs and their supporting functions every 
3-5 years, with exceptions being noted explicitly? 

= that terms of reference for program evaluations are 
appropriately cast and that no activity or issue is 
excluded without due cause? 


7 the proper reporting of program evaluation results? 


= that appropriate action is taken on the basis of pro- 
gram evaluation results? 


Is the organization structure for conducting program effec- 
tiveness evaluations the same as for program efficiency 
evaluations? 


Is the actual conduct of program evaluations centralized or 
decentralized? 


Are there appropriate evaluation staff resources? 
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Have internal resources (staff years, levels) been per- 
manently allocated to program evaluation? 


Is there temporary assignment of internal staff to conduct 
program evaluations? 


Are external resources used to supplement or to provide all 
program evaluation resource requirements? 


Are job descriptions maintained that adequately identify the 


assignment of program evaluation responsibilities and des- 
cribe the duties to be performed? 


Functional Linkages 


Are functional authorities and relationships for program 
evaluation defined and communicated within the department or 
agency? 


Is there a defined organizational linkage between the pro- 
gram evaluation function and: 


7 the office of the deputy minister or head of agency? 

- the departmental management committee? 

- the senior program managers? 

= departmental functional audit and evaluation staffs? 
(Personnel, EOW, Official Languages, Internal Audit, 


Operational Audit) 


a the strategic planning function? 


a departmental program clientele for purposes of incor- 
porating client reactions into the program evaluation 
process? 


Are all functional relationships for program evaluation 
documented, communicated and reviewed within the department 
or agency? 
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Are relevant external policy and guidelines relating to 
program evaluation appropriately communicated within the 
department or agency? 


Program Definition for Evaluation Purposes 


Has the department or agency established an appropriate 
grouping of programs or program activities for periodic 
evaluation purposes? 


Has the department established what program or program 
activity grouping is relevant for periodic evaluation? 


Have criteria been established for the development of the 
departmental or agency evaluation plan (magnitude of expen- 
diture, ease of evaluability, departmental and other priori- 
ties)? 


Is this grouping the same for efficiency and effectiveness 
evaluation purposes? 


Is this level of grouping for internal management purposes 
consistent with the requirements of all users of depart- 
mental evaluations? 


Has the department or agency established the evaluability of 
its programs or activity groupings for program evaluation? 


Has the department established the basic evaluability of 
programs, i.e. the existence of clearly articulated goals, 
objectives, activities, effects and their relationships? 


Has the department attempted to establish the basic evalua- 
bility of programs where clearly articulated goals, objec- 
tives, activities and their relationships do not currently 
exist? 


Departmental Program Evaluation Plan 


Is an appropriate evaluation plan developed, documented and 
maintained for the department or agency? 
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Has a comprehensive long range (3-5 year) departmental 
program-evaluation plan been developed? 


Has the departmental evaluation plan been approved by the 


deputy minister or head of agency? 
Ù 


Does the plan take into account the nature and scheduling of 
other “evaluation” work (operational audit, functional eval- 
uations)? | 


Have programs and activities not included in the evaluation 
plan been explicitly identified with reasons for exclusion? 


Staffing and Training 


Are there sufficient qualified staff available to fulfill all 
assigned responsibilities for program evaluation? 


Are there appropriately qualified staff to fulfill all 
assigned responsibilities for program evaluation? 


Have qualification standards for program evaluation staff 
been developed and documented? 


Have training and development requirements for program 
evaluation staff been established? 


Is there appropriate training and development for program 
evaluation staff? 


Is training and development provided by: 

= departmental programs? 

- external programs? 

Have the education needs and information requirements re- 


garding program evaluation been identified for managers and 
staffs? 
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CONDUCT AND USE OF PROGRAM EVALUATION 


Selection and Conduct of Current-Year Program Evaluations 


Has the department or agency established a process to select, 
schedule and implement current-year program evaluations? 


Does the implementation schedule of program evaluations 
reflect current management priorities? 


Are terms of reference developed, documented and approved 
for program evaluations? 


Are the issues to be addressed by program evaluations iden- 
tified, ranked and approved? 


Are evaluation design options developed and approved? 


Are implementation controls established and monitored for 
approved program evaluations? 


Do implementation plans explicitly provide for data manage- 
ment (type, source, collection) and data analysis (hypothesis, 
methodology)? 


Is there a process to communicate any findings that have an 
immediate managerial significance that are found during the 


progress of program evaluations? 


Are there quality controls on the technical validity of the 
evaluation findings? 


Reporting 


Has the department or agency established a process to ensure 
the appropriate reporting of program evaluation results? 


Is there an internal policy on the reporting and distribu- 
tion of program evaluation findings and results? 
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Utilization and Corrective Action 


Has the department or agency established a process to ensure 
the appropriate utilization and analysis of program evalua- 
tion results? 


Are there procedures to ensure that evaluation findings and 
reports are reviewed jointly by the primary users and the 
program evaluators so that the managerial relevance and 
significance of program evaluation results are understood? 


Are technical evaluation constraints documented and communi- 
cated to users of evaluations (data availability, methodol- 
ogical constraints, legal, administrative, ethical con- 
straints)? 


Are there procedures to ensure that the findings of program 
evaluations are communicated to and reviewed with appro- 
priate external users (central agencies, other departments, 
other governments)? 


Are there procedures to ensure that program evaluation 
results are appropriately analysed for current operational 
corrective actions? 


Are there procedures to ensure that program evaluation 
results are appropriately analysed for long-term planning, 
and strategic program decision-making purposes? 


Has the department or agency established a process to ensure 
that corrective action is taken, where appropriate, on the 


analysis of program evaluation results? 


Are there departmental or agency procedures to follow up the 
appropriate utilization of program evaluation results? 


Is there an adequate process to review the potential and 
actual benefit - cost of program evaluation results? 
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Area III - CONTROLLING 


Item 12 - Analysis and Corrective Action 


The theory of managerial control is that attainment of 
organizational goals is facilitated when each manager 
has an agreed time-phased plan for which he is account- 
able and one to which actual results can be compared 
and analyzed as a basis for any necessary corrective 
action. , 


In this sense, managerial control is any process that 
guides activity toward some predetermined plan or goal. 
The essence of the concept is in determining whether 
the activity is achieving the desired results. A 
control system requires: 


= a predetermined goal, a plan (See Section 1-4) 


ws, a means of measuring actual activity (See 
Section 9-10) 


= a means of comparing actual activity to planned 
(See Section 9-10) 


“ a means of analyzing and correcting the current 
activity so as to achieve the desired results 
(this section) 
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ANALYSIS AND CORRECTIVE ACTION 


Variance Analysis 


Is there a documented departmental policy requiring vari- 
ances between actual results and planned results to be 
analyzed? 


Does the policy specify acceptable variance rates and ceil- 
ings beyond which explanations of variances are required? 


Does the policy adequately explain how to carry out variance 
analysis in terms of prices and volumes? 


Is responsibility for variance analysis clearly assigned? 
Is there provision for reporting variances directly to 
responsibility centre managers and to their superiors as 


well as designated staff specialists? 


Are variance reporting requirements and formats standardized 
to the extent practical? 


Where there is no clearly identifiable output, as a minimum, 
are variances between actual and planned inputs then being 
analyzed and reported in terms of both the price and volume 


of resources consumed in relation to stated objectives? 


Are responsibility centre managers provided with adequate 
assistance from financial and other staff in: 


i identifying and analyzing variances 


™ ensuring consistency in approach to facilitate roll-up 
reports 


= improving the structure of reports 


+ improving the timeliness of input for reports 
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= improving the timeliness of availability of reports to 
managers? 


In your opinion, does the staff have the necessary technical 
skills and knowledge of the operations and accounting system 
to apply variance analysis techniques? 


Are variance analyses carried out at the appropriate organi- 
zational level where the responsibility, knowledge and 


information is located? 


Are the timing and frequency of variance analyses adequate 
for timely corrective action? 


Is there adequate integration, correlation and communication 
of operational and financial analyses? 


Corrective Action 
Do variance analysis and variance reports serve to: 


assist operating managers in demonstrating their account- 
ability both operationally and financially 


= identify where re-evaluation of priorities and reallo- 
cation of resources may be appropriate? 


Are reports and variance analyses reviewed by analysts in 
order to ensure that appropriate corrective action is taken? 


Are there procedures for the review of responsibility centre 
variance reports and analyses by higher level managers? 


Are options for corrective action identified in response to 
significant variances (e.g. to correct an unfavorable vari- 
ance directly or to offset it by favorable variances in 
other areas where savings are attainable)? 


Are the options analyzed for their impact on current and 
long-term plans and budgets? 
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12-221 Are responsibilities and procedures adequate for two-way 
communication and follow-up of control reports to ensure 
appropriate corrective action? 


12.2.8 Are there adequate procedures for obtaining approval of 
budget changes and operational changes where required? 


127299 Are there adequate procedures to ensure that significant 
_ changes in operating budgets are reflected in cash forecasts 
on a timely basis to ensure the availability or utilization 
of funds? (See Cash control, Section 7). 
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Area IV = INTERNAL AUDIT 


This focuses on the adequacy of the internal audit 
function as an effective tool of management. When 
effectively employed to complement other elements of 
managerial control, internal audit facilitates adjust- 
ments to operations to conform to prescribed or desired 
standards of performance. 


Although the questions were developed based on the 
recently approved "Standards for Internal Financial 
Audit in Departments and Agencies of the Government of 
Canada", they have been expanded in order to assess 
departmental capability to carry out a comprehensive 
audit program of both operational and administrative 
functions. The survey will also include a review on 
behalf of the TB Secretariat of the status of auditing 
compliance with TB Personnel and Administrative Policies. 
The results of the survey in these areas will be pro- 
vided to the Personnel and Administrative Policy Branches 
of the TB Secretariat. 


The area has been divided into two items: management 
of the audit function, and audit plans and results. 

The questions for the first item are designed to assess 
the adequacy of the organizational status, role and 
relationships. The second item concerns itself with 
the internal audit process and the practices utilized 
by the audit organization. 
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is _ MANAGEMENT OF THE AUDIT FUNCTION 


13 Organizational Structure and Responsibilities 
ROLE 


Does the role of the internal audit organization provide for 
an 

** independent systematic appraisal of the department's opera- 
tions and administration by: 


1 RE eae ae my identifying, reviewing, evaluating and reporting on the 
adequacy of the department's predetermined operational 
and administrative control framework (this framework 
includes all departmental policies, systems and activi- 
ties); 


is ela ae? a examining and evaluating performance in relation to 
this predetermined framework and reporting the extent 
of compliance to management; and 


IMAGE = advising management on the efficiency, economy and 
effectiveness of the operational and administrative 
functions? 

we Operational functions include all departmental programs. 


Administrative functions include such support services as 
finance, performance measurement, program evaluation per- 
sonnel (including e.g. equal opportunities for women), 
official languages and general administration. 


Scope and Frequency 
Scope 


ae bo Does the scope of audit encompass all policies, systems and 
functions that contribute to control and accountability and 
to the visibility of financial and operating information? 
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Does the internal audit organization as a matter of course 

participate in the review of design proposals for major new 
policies or systems and for significant changes or conver- 

sions in existing policies, procedures or systems, whether 

they are manual, mechanical or electronic in nature? 


Does the internal audit organization evaluate whether major 
agreements and contracts between the department and outside 
entities can be audited before they are finalized? 

Does the internal audit organization evaluate how legisla- 


tion or proposed legislation concerning the department can 
be audited? 


Is the internal audit organization consulted when the depart- 
ment is reviewing proposals for new or amended: 


= government legislation or regulations 


= central agency policies or regulations? 


Frequency of Audit 


Financial Function (and policies) 


Are all major functions of the financial function - including 
the financial controls in every financial system or program 

deemed to be operational or administrative by the department - 
subject to audit at least every three years? 


Has the internal audit organization identified any major 


components of the financial function which require review 
more frequently than every three years? 


Other Functions (and policies) 


“How often are the major components of all other operational 


and administrative functions subject to audit? 
*Questions noted with an asterisk are for information pur- 


poses only and are intended to provide a data base in such 
areas as skills, training and resources. 
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Reporting Relationship 


Does the head of the internal audit organization report to 
the deputy head or to another senior executive officer who 
reports directly to the deputy head? 


FUNCTIONAL LINKAGES 
Audit Committee 


Is there an Internal Audit Committee established under terms 
of reference approved by the deputy head? 


Is the Internal Audit Committee chaired by the deputy head, 
or a senior executive officer who reports directly to the 
deputy head? 


Is the senior financial officer a permanent member of the 


Internal Audit Committee? 


Is the head of the internal audit organization excluded from 
membership on the Internal Audit Committee? 


Do the terms of reference of the Internal Audit Committee 
include responsibilities for reviewing: 


pe audit reports or summaries of these reports and advising 
on action to be taken 


- implementation of recommendations in audit reports 
- long-term plans of the internal audit organization 
x the annual plan of the internal audit organization 
whether or not major changes in the components (policies, 


systems and activities) of the department's operational 
and administrative functions can be audited 
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a reports from Office of the Auditor General or Treasury 
Board and implementation of corrective action? 


Is there evidence available in the documented proceedings, 
formal minutes etc. of the meetings of the Internal Audit 
Committee to indicate that it is functioning effectively? 


* Coordination/Integration of Audit Activities 


Is the internal audit organization the sole organizational 
entity having internal audit responsibilities? 


Where separate internal audit or evaluation groups exist in 
the department: 


ry are there clear terms of reference for each group? 

- are the annual schedules of each group effectively 
coordinated to avoid duplication or overlapping of 
work, undue interference to operations and value for 


the total resources committed to audit/evaluation? 


a is there an exchange of audit reports and related 
information? and 


Fr is there coordination of any required follow-up by each 
group? 


Audit Agents 


*Does the main internal audit organization use agents to 
conduct some or all of its internal audits? 


*What is the cost of the internal audit work carried out by 
agents: 


2 in dollars 
= in equivalent person years 


à as a percentage of the total operating cost of the main 
departmental internal audit organization? 
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*What types of audits are carried out by the audit agent: 


- financial 


- operational 


= composite 

= other? 

Is there a written agreement with the audit agent? 

Is the agreement sufficiently comprehensive to ensure that 
departmental and central agency standards for internal audit 
will be met? 

Does the agreement with the audit agent clearly specify: 

= the objectives of the audit 

= the scope and frequency of the audit 

= the reporting relationships of the audit agent 


= the authority and responsibilities of the audit agent? 


Does the agreement with the audit agent give the department 
the right to: 


= examine and approve audit plans and schedules 


= gain access to audit documentation sufficient to ensure 
that required audit standards are maintained 


= require specific detailed information in support of 
audit observations and recommendations? 


Is the internal audit organization aware of and do they 
properly utilize the specialist audit expertise that exists 
in other departments and agencies (e.g. the RCMP Security 
and Evaluation Inspection Team vis-a-vis EDP security)? 
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Audit Independence 


Is the internal audit organization established under a 
formal internal audit policy approved by the deputy head? 


Is the internal audit policy communicated effectively to all 
appropriate departmental personnel? 


Does the internal audit policy give the internal audit 
organization access to all departmental information, re- 
cords, documents and reports that they deem to be related to 
the fulfillment of their responsibilities? 


Does the internal audit policy grant the internal audit 
organization reasonable access to all departmental staff in 
order to obtain all information and explanations necessary 
to their examinations? 

Does the teste audit policy restrict the internal audit 
organization from participating in the development or imple- 
mentation of policies, systems or activities which it may be 
called upon to examine and review? 


Does the internal audit organization have an audit manual 
which describes: 


= goals and objectives of the internal audit organization 
= internal audit policies and procedures 

= standards of field work 

= organization of internal audit 


- duties and responsibilities of each level in the inter- 
nal audit organization? 
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Staffing and Training 


Group Characteristics 


Is there an up-to-date organization chart of the internal 
audit organization? 


*Of the person years actually utilized by the internal audit 
organization during the previous fiscal year, what is the 
percentage at: 
= the supervisory level 
“ the working level 
- the secretarial/clerical level? 

*What percentage of the internal audit organization's total 
authorized person years for the previous fiscal year were 
not staffed (i.e. not utilized) at: 
= the supervisory level 


- the working level 


- the secretarial/clerical level? 


: Is there a documented resource plan which calculates total 


staff requirements (including those to be obtained from 
audit agents) in relation to audit responsibilities docu- 
mented in the long-range plan? 


Does employee turnover (or lack of continuity) appear to be 
a problem? 


‘Do all the internal audit staff have a basic knowledge of 
computer controls and the auditability of E.D.P. systems? 


Individual Characteristics 


*How many persons in the internal audit organization have 


_ professional expertise in: 
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= accounting 

- EDP (technical expertise other than audit) 

- computer audit 

s statistics 

= systems and industrial engineering 

- other specialist skills (specify)? 
“How many of the persons indicated above are employed: 

= at the supervisory level 

= at the working level? 

Do inexperienced staff members work under the direct super- 


vision of a person with sufficient qualifications and experi- 
ence? 


Professional Development 


Has a formal training and orientation program been designed 
specifically for new members of the internal audit staff? 


Is there a formal plan for the continuous training and 
development of internal audit staff? 


Is there a formal training plan to ensure that all audit 
staff have a basic knowledge of computer controls and the 


techniques of auditing E.D.P. systems? 


Are all members of the internal audit staff given demon- 
strable opportunities for training and development? 


Is the internal audit training and development plan inte- 
grated with the departmental training and development plan? 
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Is each member of the internal audit staff given a formal 
written performance appraisal at least annually? 


Does the periodic appraisal: 


= review the individuals strengths and weaknesses in 
relation to the duties of the position 


= describe short-term and long-term goals 

= review employee progress since last appraisal 
= identify training needs? 

Planning and Scheduling 


Long Term Plan 


Has the internal audit organization prepared and documented 
a long-term plan to meet efficiently and effectively the 
departmental policy on internal audit? 


Is the long-term plan reviewed and up-dated annually? 


Is it designed to meet the departmental audit policy as to 
the overall scope and frequency of audit? 


Is the long-term plan prepared from a systematic, logical 
and documented analysis of the organization's total internal 
audit responsibility, by function, organization and program? 


Does the process of analysis of the total internal audit 
responsibility include: 


= identification of manageable audit units 
= evaluation and ranking of audit units in order of 
priority (taking into consideration such factors as 


size, risk of loss, known desires of senior management, 
etc.)? . 
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*Indicate if audits are scheduled according to the following 
functions together with the projected cost ($ and person 
days): 
= performance measurement 
- program evaluation 
= personnel 
m equal opportunities for women program 
official languages program 
# E.D.P. policy and plan 
* management controls 
- administrative policies (list inclusions) 

Is advice sought from the Internal Audit Committee and 
senior officers having functional responsibilities (e.g. the 
senior financial officer) when preparing the long-term 


internal audit plan and annual schedule of audits? 


Does the long-term plan include an estimate of the numbers 
of audit staff and skills required? 


Does it include an estimate of the total cost of the inter- 
nal audit function in salary and other resources? 


Is the long-term plan sufficiently balanced so that a variety 
of components of the various functions and organizational 
units are covered annually within the established cycle of 
audit? 


Annual Schedule 


Does the internal audit organization prepare an annual 
schedule of planned audit assignments? 


Is the annual internal audit schedule (with supporting 
narrative) submitted to: 
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= Internal Audit Committee 

3 deputy head? 

Does the annual internal audit schedule: 

= define scope and Sos cb ie of each audit assignment 


Cd estimate person days and other resources for each 
assignment? 


*What percentage of time during the previous fiscal year was 
spent on: 


- scheduled audits 
- unscheduled audits 


= special assignments of a non-audit nature? 
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AUDIT PLANS AND RESULTS 


The Internal Audit Process 


The remainder of this questionnaire is intended to evaluate 
the methodology employed by the internal audit organization 
in performing audit assignments. 


The questions are based on the assumptions that there are 
five basic phases in the internal audit process (assignment 
planning, review, evaluation, verification and assignment 
reporting) and that proper execution of the first four 
phases rests on several basic audit concepts (due care, 
evidence, documentation, materiality and assignment manage- 
ment). 


The questions pertain to both financial and operational 
auditing situations, although several of the review, evalu- 
ation and verification questions are more oriented to 
financial audit. 


Assignment Planning 


Is a specific plan of action developed prior to the com- 
mencement of each internal audit assignment? 


Is the audit plan documented in an assignment memorandum 
which sets out: 


* scope and objectives of the audit 


= the policies, systems and activities selected for 
audit 


~ the audit approach (which includes in a computer 
environment, complete consideration of computer con- 
trol objectives and standards and computer oriented 


audit techniques) 


né assignment of staff, including use of agents and 
specialized skills 


ms a time-phased budget 
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= responsibility for preparation of the audit report 
= supervision and review arrangements 


= any constraints such as availability of audit or 
auditee personnel and 


= the potential impact of the assignment on future 
internal audit assignments? 


In determining the audit approach in the assignment plan, 
is adequate consideration given to the impact that conver- 
sions to new methods and procedures, whether manual or EDP, 
will have on the accuracy and reliability of records and 
the effectiveness of the control framework? 


The Review Phase 


Is a meeting held with the management of the area subject 
to audit at the commencement of each assignment? 


Do audit working papers show that a thorough and consistent 
study and documentation of the control framework has been 
made? 


Do audit working papers indicate that a sufficient veri- 
fication has been carried out to ensure that the control 
framework is operating as documented? 


(For computerized systems the verification should include 
regular accounting transactions and master file change 
transactions.) 


Do the audit working papers indicate whether there was an 
investigation and documentation of environment controls 
which operate outside but have an impact upon the system 
under review? 


Examples of environment controls could be the participation 
of management in systems complementary to the transaction 
recording and control system (e.g. setting, controlling and 
analyzing budgets and variances, or the provision for 
rotation and segregation of duties among employees). 
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The Evaluation Phase 


Is the evaluation performed to identify essential controls, 
significant weaknesses, and major inefficiencies in the 
operational and administrative control framework? 


Do the audit working papers show that the controls, defi- 
ciencies and inefficiencies identified during the evalua- 
tion were the result of a thorough analysis of the opera- 
tional and administrative control framework documented in 
the review phase? 


Is the evaluation accomplished by comparison of the design 
of the operational and administrative control framework, as 
documented in the review phase, with a predetermined con- 
trol model? 


Are internal control questionnaires or checklists employed 
in the evaluation? 


Is consideration given to the effect of compensating con- 
trols and environment controls in the evaluation of apparent 
deficiencies in the area under audit? 


Does the evaluation include a thorough review of the effect 
that the compensating and environment controls have on the 
different weaknesses in the area under audit? 


Does the evaluation include a review of financial controls 
in the processing stage of computerized systems located 
off-site in other departments or commercial service bureaux 
(except for government-wide systems)? 


The Verification Phase 


Do audit working papers substantiate that an in-depth 
verification has been carried out: 
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= to determine that essential controls identified in the 
evaluation phase are operating as designed and are 
effective 


+ to substantiate significant deficiencies and major 
inefficiencies identified in the evaluation phase? 


Are the additional significant deficiencies and major 
inefficiencies discovered in the course of verification of 
essential controls subject to the same verification as 
those identified in the evaluation phase? 


Is the program of verification of significant deficiencies 
and major inefficiencies designed to determine their cause 
as well as their real or potential effect? 


Is there a comprehensive internal audit program which 
clearly defines the objectives of each verification step? 


Are the verification techniques employed compatible with 
the objectives of each verification and consistent with the 
nature of the policy, system or activity under review? 


Does the internal audit organization employ statistical 
sampling or computer-assisted audit techniques whenever 
appropriate? 

Are audit findings fully discussed with the auditee as an 


additional means of verification before the draft audit 
report with recommendations is prepared? 


Basic Concepts 


Due Care 


Has each phase of every internal audit assignment been 
carried out with due care by a person or persons who: 
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= have the appropriate degree of knowledge and experi- 
ence with respect to the area selected for audit 


: have the technical training and competence to carry 
out the specific audit routines? 


(Due care is defined as a professional obligation to 
execute every responsibility with the care expected of 
a reasonable man with the same or similar qualifica- 
tion in similar circumstances. ) 
Evidence 
Do the internal audit working papers show that sufficient, 
appropriate and valid evidence has been obtained to afford 
a reasonable basis for the auditor's findings, observations, 
conclusions and recommendations? 
Documentation 


Are there adequate working paper files which: 


= document all phases of the internal audit assignment 
from planning to execution to conclusion 


x provide proper support for observations and recommen- 
dations in the audit report? 


Are there adequate written procedures for: 
= preparation of internal audit working papers 


“ filing, indexing and referencing of internal audit 
working papers 


- retention of internal audit working papers 


” maintaining the confidentiality of internal audit 
working papers? 
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Materiality 


Do the internal audit working papers indicate that due 
consideration has been given to the concept of materiality 
in each phase of the internal audit process? 


(Materiality limit may be defined as the aggregate amount 


of errors which, if they had occurred, would cause manage- 


ment serious concern as to the continued effectiveness of 
the financial systems under examination. ) 


Assignment Management 


Does the internal audit organization have documented pro- 
cedures for the management of audit assignments which 
include: 


details of the organization of internal audit teams, 
line of authority and responsibility of each auditor 


procedures to ensure that all staff engaged in the 
conduct of an internal audit assignment are subject to 
adequate supervision? 


Supervisory Review 

Do the documented procedures for management review show 
that there are supervisory review points at the following 
phases of the audit: 

i assignment planning 

+ review 

- tion 

e verification 

- assignment reporting? 

Audit Assignment Reports 


Is a written report issued to appropriate officials of the 
department at the conclusion of every audit assignment and 


do they recommend corrective action when appropriate? 
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Is the report issued after review and under written au- 
thority of the head of the internal audit group? 


Are the reports issued on a timely basis? 

Is the content of the audit reports: 

3 as concise as possible, yet clear and complete? 
= ‘objectively and constructively presented? 


Do the audit reports contain a clear statement of audit 
scope and objectives? 


When opinions or conclusions are expressed in audit reports 
are they clearly represented, and is the basis upon which 
they are expressed indicated? 


Are the observations in the audit report supported by 
adequate working papers? 


Do the audit reports include only significant findings? 


When the problems or deficiencies are identified, does the 
report: 


ae include sufficient details and evidence to justify the 
observations 


= state the causes of the problem, financial or other 
implications of the problem, and principles involved? 


Do the audit reports give a clear indication of the area 
and level of management responsible for taking corrective 
action? 


Are audit findings and recommendation discussed with rele- 


vant officials prior to issuing the report and are their 
comments included in the report, as appropriate? 
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Do the audit reports refer to good practices whenever they 
are identified during an audit as a means of encouraging 
general acceptance and implementation? 


Does the head of the internal audit organization have the 
right to report audit findings to any management level in 
the department? | 


Are audit reports issued: 


- to all ‘otticiais, both line and functional, directly 
responsible for taking action on matters raised? 


= to their superior officers? 


Discussion of Audit Findings and Recommendations 


Are matters of disagreement with or comments obtained from 
responsible officials stated in the audit report? 


Follow-Up 


Do the departments’ internal audit policies clearly indi- 
cate that responsibility for taking action on audit findings 
and recommendations rests with the officials responsible 
for the function? 


Are documented procedures, which ensure that management 
action is taken, included in the departmental financial, 
administrative, operational and internal audit manuals? 


Does the internal audit organization have established 
procedures for follow-up on audit recommendations? 


Do audit reports contain reference to the extent and effec- 


tiveness of corrective action taken on recommendations made 
in previous reports? | 
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During the past year,.in what percentage of the cases did: 
= management concur with the audit recommendations 
+ implement the recommendations? 


Summary Reports To The Deputy Head 


Does the head of the internal audit organization submit a 
comprehensive report annually to the deputy head? 


Does the summary report to the deputy head: 


set out the coverage and results of audits compared to 
the annual audit schedule; 


= summarize major audit findings and recommendations; 


es comment on the extent of management follow-up and 
implementation of corrective action; 


> provide overall conclusions on the adequacy of major 
components of the operational and administrative 


systems; and 


= highlight other important matters requiring the deputy 
head's attention? 


January 1979 
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